Applying a resources framework to analysis of the Force and Motion Conceptual 

Evaluation 
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We suggest one redefinition of common clusters of questions used to analyze student responses on 
the Force and Motion Conceptual Evaluation (FMCE). Our goal is to move beyond the expert/novice 
analysis of student learning based on pre-/post-testing and the correctness of responses (either on 
the overall test or on clusters of questions defined solely by content). We use a resources framework, 
taking special note of the contextual and representational dependence of questions with seemingly 
similar physics content. We analyze clusters in ways that allow the most common incorrect answers 
to give as much, or more, information as the correctness of responses in that cluster. Furthermore, 
we show that false positives can be found, especially on questions dealing with Newton's Third Law. 

PACS numbers: 01.40.Fk. 01.40.gf 



I. INTRODUCTION 

Students are not yet physicists. They have not had 
the extensive training that we, as physicists, rely on. 
As a result, it is often inappropriate to categorize and 
group student responses to physics questions solely on 
the basis of agreeing with correct Newtonian principles, 
as is commonly done with standardized tests such as 
the Force Concept Inventory (FCI) and the Force and 
Motion Conceptual Evaluation (FMCE) . [TJ H [3] Unfor- 
tunately student assessment using the FMCE, including 
work previously done by one author (M.C.W.), regularly 
does just that.jl] The test questions are grouped into 
clusters according to a physicist's view of equivalent con- 
tent areas, and students' responses are evaluated based 
on their agreement with a physicist's viewpoint without 
regard for why students might choose incorrect answers. 
This may be a valid form of assessment for determining 
how well students think like physicists, but it is often 
an insufficient method for determining how students rea- 
son about scenarios in a physics context. In order to 
effect greater conceptual development in our students, 
we must understand not only where we wish them to end 
up, but also where they are beginning in terms of their 
understanding of the world around them. Only by having 
this entire picture may we devise a manner by which to 
help our students truly gain a physicist's understanding 
of their surroundings. 

This paper describes ways in which the FMCE can 
be organized and used to get more detailed information 
about students. Presently, many researchers and edu- 
cators using the FMCE follow a particular procedure 
that includes three steps: 1) administering the FMCE 
pre- and post-instruction, 2) dividing the questions into 
content-based clusters, and 3) evaluating the correctness 
of each student's responses within each cluster as well as 
over the entire test. Several years ago a template was 
developed by one author (M.C.W.) to analyze students' 
responses to the FMCE within five clusters (Velocity, Ac- 
celeration, Force (Newton's 1** and 2"'^ laws), Newton's 
3'''' law [5], and Energy). [3] The template automatically 



scores each response as correct or incorrect, groups ques- 
tions into the aforementioned clusters, and calculates a 
class's normalized gain for each cluster as well as over the 
entire test. This template has become widely used due 
to its availability and its succinct analysis of students' 
responses. Recent research using the FMCE and model- 
ing using a resources framework [SJ [71 [^ has convinced us 
that analysis based on the use of this template lacks the 
depth and rigor we have come to expect from studies on 
students' understanding of Newtonian mechanics. We 
propose several modifications to the described analysis 
including a redefinition of clusters and a deeper analysis 
of students' incorrect responses. 

The clusters mentioned previously divide the FMCE 
very nicely into groups of questions that each exam- 
ine a different content aspect of physics. But many 
studies, including those by Beichner[S] and Kohl and 
Finkelstein|101 fTTj . have shown that the manner in which 
material is presented may significantly affect students' 
abilities to demonstrate their understanding. For exam- 
ple, Beichner has shown that students' understanding (or 
lack of understanding) of graphs can have a profound 
impact on their responses to physics questions involving 
graphs. |9j Furthermore, results by Dykstra and others 
show that elements of the physical situation greatly affect 
reasoning. Dykstra reports on students' troubles reason- 
ing about motion in which an object has a turning point; 
that is, when an object under the influence of a constant 
force moves in a particular direction while slowing down 
and then reverses direction and speeds up. [12 

Our goals in this paper are not new. Several re- 
searchers (notably Thornton[13, [14] and Dvkstra[T2]) 
have used results from the FMCE to give fine-grained 
analyses of students' responses to the FMCE. Unfortu- 
nately, their methods are not widely used among physics 
educators and education researchers. Also, we wish to 
anchor our analysis in a resources framework, making ex- 
plicit connections to the representational and contextual 
dependence of responses. In addition, Bao has proposed 
new clusters of questions to investigate reasoning. We 
respond to Bao's work in more detail in section [TTj 



In section [TT] we both respond to existing clustering 
methods (including our previous one) and propose new 
clusters. In section Hill we discuss various incorrect men- 
tal models that correspond with the content areas de- 
scribed by each of our clusters. In section IV we examine 



how these mental models are aligned with particular re- 
sponses to questions in the FMCE. Using a definition of 
clusters consistent with a resources framework allows us 
to go into greater detail about students' incorrect mental 
models and identify responses that correspond to these 
models. In this section, we include a discussion of false 
positives, as measured by looking at responses on sev- 
eral questions within a representationally and contextu- 
ally consistent set of questions. 



II. REVISED QUESTION CLUSTERS FOR THE 
FMCE 

The five analysis clusters, shown in tablejlj were chosen 
by Wittmann as a quick and dirty analysis of classroom 
performance on the FMCE. These clusters were defined 
based on the content of each question on the FMCE — 
the Velocity cluster asks students about the velocity of 
an object undergoing a series of described motions, the 
Force (Newton I & II) cluster asks students about the 
force (s) exerted on an object during a described motion, 
and so on. Several questions are not included in any 
of the clusters; Thornton and Sokoloff omit these from 
regular analysis of the FMCE because they are intended 
for diagnostic purposes (such as reading ability) or do 
not give a definitive indication as to whether or not a 
student is properly using Newtonian reasoning. [3J More 
details of these omissions can be found in refs. [TU [TS] . 



TABLE I: Clusters of questions on the FMCE as previously 
defined by Wittmann. 



Cluster 



Questions 



Velocity 

Acceleration 

Force (Newton I & 

Newton III 

Energy 



40-43 
22-29 
II) 1-4, 7-14, 16-21 
30-32, 34, 36, 38 

44-47 



There are obvious flaws to the old clustering of ques- 
tions, the largest being that different representations and 
contexts are asked about in many clusters. If students 
are inconsistent in their thinking about the physics (as 
assumed in a resources framework), then results in each 
cluster should be noisy and inconsistent, as well. 



A. Defining new clusters 

To understand student reasoning better, we should use 
a finer-grain resolution in the questions that we analyze 



and group. We use the questions of the Force (Newton I 
& II) cluster, shown in figures [I||3J to illustrate. 

In answering the questions in figures [l]-|3] students 
must determine the force on an object (sled, toy car, 
coin) undergoing a described motion. In terms of repre- 
sentations, figures [l] and |3] use pictorial representations, 
while figure |2] uses graphical representations. In terms of 
context, the questions in figure [T] and [2] are about mo- 
tion in a single direction, while the questions in figure [3] 
involve an object that reverses the direction. 
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FIG. 1: Questions 1-7 of the FMCE[3: contained within 
original Force (Newton I & II) cluster and revised Force Sled 
cluster. 

To measure dependence of student reasoning on the 
representational and contextual cues in figures [lH3] we 
have created new clusters which replace the old Force 
(Newton I & II) cluster: the Force Sled cluster (contain- 
ing the questions in figure Q , the Force Graphs cluster 
(containing the questions in figure p|, and the Revers- 
ing Direction cluster (containing the questions in figure 
[3] as well as others). The Reversing Directions cluster has 
been expanded to include questions about acceleration as 
well as force; questions 27-29 on the FMCE inquire about 
the acceleration of a coin tossed in the air as it moves up 
and back down, isomorphic to questions 11-13 but in the 
context of acceleration. 

Table |ll] shows the full definitions of the revised clus- 
ters, ordered by question number on the test rather than 
difficulty of the physics material. These clusters are con- 
sistent with those used by Thornton. [T^ Note that the 
definitions of the original Newton III, Velocity, and En- 
ergy clusters have been directly transferred to the revised 
clusters. To conform with the specificity of the Force 
Graphs and Acceleration Graphs clusters, the Velocity 
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FIG. 2: Questions 14-21 of the FMCE '3^: contained within 
original Force (Newton I & II) cluster and revised Force 
Graphs cluster. 



cluster has been renamed the Velocity Graphs cluster. 
Most of the original Acceleration cluster has been trans- 
ferred to the Acceleration Graphs cluster (the other accel- 
eration questions are in the Reversed Direction cluster). 
These revised clusters increase the information that can 
be taken from an analysis of the FMCE by highlighting 
and isolating content areas, types of representations, and 
specific situations with which students may struggle. We 
give examples in section ITV] 



TABLE II: Revised clusters on the FMCE. 



Gluster 

Force Sled 

Reversing Direction 

Force Graphs 

Acceleration Graphs 

Newton III 

Velocity Graphs 

Energy 



Questions 

8-13, 27-29 

14, 16-21 

22-26 

30-32, 34, 36, 38 

40-43 

44-47 
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FIG. 3: Questions 8-13 of the FMCE[3]: contained within 
original Force (Newton I & II) cluster and revised Reversing 
Direction cluster. 



states are more easily detected using samples of questions 
that span several physical contexts. (TB] As such he has 
defined the cluster of questions in table |11I| to compare 
students' use of two particular models (force proportional 
to acceleration, and force proportional to velocity).^ His 
cluster contains questions from both the Force Sled (ques- 
tion 2) and Reversing Direction (questions 11 & 12) clus- 
ters as well as question 5, which Thornton and SokolofF 
suggest should only be used as a measure of reading abil- 
ity rather than Newtonian thinking. |15j 

Using a resources framework, we can explain the pres- 
ence of mixed model states as being the result of con- 
textual cues or representational cues. Thus, by creat- 
ing a cluster that mixes cues, he has primed his data to 
show mixed model states while not being able to explain 
the source of model mixing, be it contextual, represen- 
tational, or due to deeper issues with the physics. Of 
course we expect our students to understand concepts in 
all contexts, but mixing cues makes our analysis of stu- 
dent reasoning much more difficult and fails to give the 
resolution that we, as researchers and instructors, desire. 

A further weakness of the mixed context cluster is the 
use of question 5, which describes two kinds of motion 
(accelerating followed by constant velocity), and should 
be checked against question 2 on the FMCE for consis- 
tency. Typically, students score very well on this question 



Other ways of clustering questions on the FMCE exist. 
In his Ph.D. dissertation, Bao claims that mixed model 



^ Table |lll| also shows the response to each question that corre- 
sponds with each of these models. 



(unless they have reading problems in understanding the 
question). Thus, adding this question necessarily skews 
the data toward correct model use. 

We believe that it is far more beneficial for instructors 
to first group questions that deal with a single physical 
context (e.g. constant force applied to move an object 
horizontally) before combining questions across diverse 
contexts. Our approach is more consistent with the as- 
sumptions of a resources framework, and gives new in- 
sight (as described below in the section on false positives). 
We do still observe students' use of mixed models, but 
within a single physical context. Such a mixed model 
indicates a kind of inconsistency in thinking about the 
physics that a mixed-context cluster cannot. 



may examine how various resources could combine to cre- 
ate robust (and often incorrect) mental models (or con- 
cepts) that students use when reasoning about physics. 
We give several examples below. 

In this section, we describe the resources that students 
often use when answering questions on the FMCE. In 
some cases, we draw resource graphs. In section |IV] we 
connect these descriptions of resources to the questions 
on the FMCE. 



A. Dynamics 

1. Newton's 1st and 2nd laws 



TABLE III: Question cluster defined by Bao to use Model 
Analysis with the FMCE. 16 



Question 
Number 



Foe 



F (X V Other 



2 


D 


B 


others 


5 


D 


B 


others 


11 


A 


G 


others 


12 


A 


D 


others 



III. FACETS, RESOURCES AND MENTAL 

MODELS OF STUDENT REASONING ON THE 

FMCE 

As we have stated from the outset, we use a resources 
framework to cluster responses on the FMCE. We are 
not using a conceptions approach p!^ [Tfl [T5] because we 
are seeking a higher resolution to understand what stu- 
dents have mastered in their physics learning (and how 
best to help those who have not yet mastered the ma- 
terial) . The resources framework can be thought of as a 
schema theory that emphasizes knowledge-in-pieces, such 
as phenomenological primitives (p- prims) [19], facets[7j, 
and resources [SJ [2D]. The differences and connections 
between a concept-based and resource-based analysis of 
student reasoning and teaching are discussed in more de- 
tail by Scherr.[2T] 

Student thinking is rarely described in terms of an in- 
dividual, small idea such as "closer means stronger" , for 
which appropriate applications are sitting by a fire to 
be warmer or moving from speakers at a concert to save 
one's hearing, and false applications include attributing 
the change in seasons to a difference in the distance from 
the earth to the sun. Instead, succinct descriptions of 
student thinking often require us to recognize the use of 
multiple resources in connection. We represent this as a 
type of nodal mental space network, a resource graph. [5] 
The connections, or links, between these resources vary 
greatly in both strength and duration. Assuming that 
students are using a set of resources related to mechan- 
ics and kinematics, not all activated in every question, we 



The notion that the force exerted on an object 
is proportional to its velocity has been reported by 
many researchers and is very prevalent among physics 
students. [T11H31 US] The F oc v model has been described 
as being similar to the Impetus view of physics [23] but 
can be described in more detail by several of Hammer's 
resources including "activating agency" and (in partic- 
ular) a "maintaining agency" [S] that is "dying away."^ 
The "activating agency" resource is the notion that ev- 
ery event must have a cause, i.e. every object that is in 
motion must have had something to get it started. The 
"maintaining agency" resource embodies the idea that 
objects in motion must have something (some "agent") 
to keep them in motion. While neither of these resources 
is incorrect in and of itself, the F oc v model is evident 
when the "agent" required for each of them is seen as the 
force applied to an object.^ The "maintaining agency" 
when used in this context contradicts Newton's first law, 
but students' intuitive ideas are not unreasonable. They 
are, instead, consistent with years of experience in our 
friction-filled world where a continuous application of 
force is almost always needed to maintain an object's 
motion. 



2. Newton's 3rd law 

Studies have shown that students use a variety of 
strategies when reasoning about the forces exerted be- 
tween two interacting bodies. [M||25l US] Bao, Hogg, and 
ZoUman identified four "contextual features" that stu- 
dents use when responding to questions regarding New- 
ton III: velocity, mass, pushing and acceleration. [24] For 
example, an object with a larger initial speed will ex- 
ert more force than an object with a smaller initial 



^ These and many other resources are lightly derived from diSessa's 
p-prims.|19| 

^ One could argue that this is only a problem if the students use 
the net force for each of these resources; however, the fact that 
the FMCE presents questions that involve a single applied force 
on a frictionless surface makes this a moot point. 



speed (during a collision), and more massive objects ex- 
ert more force than less massive ones. The velocity 
and mass features work well together to illuminate stu- 
dents' implicit confusion between momentum and veloc- 
ity. Based on their ideas about kinematics, students often 
have a desire to represent force as F — mv;^\ further- 
more, students may use the terms momentum and force 
interchangeably. _24J The pushing feature is contained in 
the notion that, when one object pushes another, the ob- 
ject that is pushing must exert more force than the object 
that is being pushed. This idea is typically accompanied 
by the reasoning that if both objects exerted the same 
force on each other, neither would move. 

We have previously reported on students' use of three 
facets when considering Newton's third law: the mass 
dependence facet, the action dependence facet, and the 
velocity dependence facet. [5S] These mental models cor- 
respond with Minstrell's facets of knowledge, [7^ in par- 
ticular facets 62 (The moving object or a faster moving 
object exerts a greater force), 63 (The more active or en- 
ergetic object exerts more force), and 64 (The bigger or 
heavier object exerts more force).'* The mass dependence 
facet has a direct correlation with the mass contextual 
feature described by Bao, et al.[24 The action depen- 
dence facet combines the velocity and pushing contex- 
tual features described above to create a mental model 
that is applicable to both pushing and collision situa- 
tions. The velocity dependence facet describes students' 
use of force as an intrinsic property of an object, similar 
to momentum, agreeing with the velocity contextual fea- 
ture described by Bao, et al.[531|2Sj Maloney uses many 
similar ideas to describe students' use of a "dominance 
principle" to reason about the interaction between two 
bodies. [25] Maloney's "dominance principle" is also very 
closely related to diSessa's "Ohm's p-prim" as well as 
Hammer's "more is more" resource. [51 [T^ 

The "more is more" resource might manifest itself 
within students' thinking of Newton's third laws as a 
series of connections: the more mass or speed an object 
has,^ the more damage it can do; the more damage an 
object can do, the more force it must exert on any other 
object. Another connection that can be made along these 
lines is the idea that the more an object reacts after a col- 
lision, the more force must have been applied to it.|27j In 
this case, the "more is more" resource is used indirectly 
to describe the object that is exerting the force on the 
object in question. 

We draw a resource graph of student reasoning about 
Newton's third law in order to summarize these com- 
ments. In figure |4] we show how four resources can 
combine in groups of three to create the two observed 
mass and action dependencies. Note that the combina- 
tion of "More means more" and "Unbalanced (competi- 



tion)" can be interpreted as diSessa's Ohm's p-prim [T^. 
in which more resistance (say, a mass in the way) requires 
more force for equal effect. 




FIG. 4: The mass dependence and action dependence re- 
sources may be derived from universal primitives and obser- 
vations of a scenario. 



B. Energy 

The "more is more" resource discussed above may also 
be applied when discussing students' views of the transfer 
of energy. For this particular discussion we will use the 
scenario of a sled starting from rest at the top of an 
icy hill and sliding all the way down (as is seen in the 
FMCE). In this case, the "more is more" resource may be 
used quite nicely (and correctly) in stating that the more 
height a hill has, the more kinetic energy (and thereby 
speed) the sled will have once it has reached the bottom. 
Students may connect "more is more" to other elements 
of the problem, instead, including more steepness or more 
length. Students might, for example, take the approach 
that the steeper a hill is, the faster (or more energetic) the 
sled will be when it gets to the bottom. Students most 
likely take this idea from their own experiences sliding 
down hills; the steeper hills are always more fun and get 
them to high speeds sooner. They attach the "more is 
more" resource to the acceleration of the sled, i.e. the 
rate of change of the velocity varies with the slope of the 
hill but not the total change in speed. 



IV. MENTAL MODELS EVIDENT IN EACH 
CLUSTER 



We return to the revised clusters defined in section 



* Definitions of these facets can be found in refs. l7ll25l . 
^ Possibly tacit indicators of momentum or kinetic energy. 



pl applying the resources presented in section III For 
each cluster of questions, we examine the possible re- 
sponses to individual questions and determine which cor- 
respond with the use of correct Newtonian reasoning 
and which indicate the use of one of the mental mod- 
els discussed in section |III[ We will also compare these 
responses with the most common student responses re- 
ported by Thornton, T^ showing that the FMCE can be 



interpreted in ways consistent with a resources frame- 
work. Furthermore, we will show that the use of a re- 
sources framework lets us conclude that some student re- 
sponses are actually false positives (i.e. correct responses 
given for incorrect reasons). 



A. Force Sled Cluster 

The Force Sled cluster (see figure IT]) asks questions in 
plain language (i.e. not graphically), has no reversing di- 
rection questions, and deals with a single applied force 
that is therefore also the net force on the sled. Offered 
responses on this cluster include the correct idea that the 
net (and appUed) force is proportional to its acceleration 
(or rate of change of velocity) , as well as the notion that 
the net force on the sled is proportional to its velocity. 
Table |IV| shows the responses that correspond with each 
of these models as well as the most common student re- 
sponses. The most common student responses found by 
Thornton [13] are the same as those indicating a student's 
use of the F oa v model. This similarity provides strong 
evidence that many students believe that the net force 
on an object is proportional to its velocity, rather than 
its acceleration. We interpret these results in terms of 
resource activation, though this interpretation is, in this 
case, not necessary. 

TABLE IV: The "Force Sled" cluster on the FMCE. 



Question 
Number 


F 


oc ^ 

"^ At 


F (X V 


Most Common 
Student Responseli3l 


1 




b 


a 




a 


2 




d 


b 




b 


3 




f 


c, g 




c 


4 




f 


g 




g 


7 




b 


e 




c 



B. Reversing Direction Cluster 

The Reversing Direction cluster (see figure Isl asks 
questions in which an object has been tossed in the air 
(or rolled up a hill). Students must think about the net 
force and the acceleration throughout its up-and-down, 
free-fall motion.^ Within the Reversing Direction clus- 
ter, the questions are broken into three sub-clusters (8- 
10, 11-13, and 27-29), each of which involves a single 
object undergoing an up-and-down motion. In each of 



® Note that, while the ramp on which the toy car rolls in questions 
8-10 prevents it from truly being in free-fall, the up and down 
motion of the car travelling under its own volition is analogous 
to the coin toss in questions 11— 13.(13] 



these sub-clusters the students are asked about the force 
exerted on the object (questions 8-13) or the acceleration 
of the object (questions 27-29) as it goes up (questions 8, 
11, and 27), at the highest point in its journey (questions 

9, 12, and 28), and as it comes back down (questions 

10, 13, and 29). According to Thornton and Sokoloff, 
student responses are only considered correct when all 
three questions within a given sub-cluster are answered 
correctly. 13] We expand on this point below. 



1. A generalized force-in-direction-of-motion model 

As with the Force Sled cluster, the Reversing Direc- 
tion cluster provides possible responses that correspond 
directly with the F ex v model (or a oc f model for ques- 
tions 27-29). For the questions in the Reversing Direc- 
tion cluster, however, it is beneficial to consider a general- 
ization of the F (X V model: the force/acceleration-in-the- 
direction-of-motion model. This more general model ig- 
nores the magnitude of the force or acceleration through- 
out each part of the motion and only describes the di- 
rection. Consider questions 11-13 (coin toss force ques- 
tions). A student using the F oc v model would indicate 
that the force on the coin is upward and decreasing as the 
coin goes up, zero at the top of its motion, and downward 
and increasing as the coin comes back down. But what if 
a second student thinks that the force is upward and con- 
stant while the coin travels up, but agrees with the first 
student on the other two questions? This student cannot 
be considered as using the F ex v model, but may be 
classified within the direction-of-motion model. In fact, 
our F (X V student may also be categorized as using the 
direction-of-motion model. In this way the direction-of- 
motion model allows a broader classification of students 
who have similar, but not necessarily identical ideas. 

Our decision to used the generalized direction-of- 
motion model is data-driven. Research conducted by one 
author (T.I.S.) suggests that considering the direction-of- 
motion model for the Reversing Direction cluster allows 
many more students to be classified into a common model 
than the F oc v model. [28^ Incorporating the direction- 
of-motion model into the results from the Force Sled or 
Force Graphs clusters, however, did not add any signifi- 
cant information. We suspect this is due to the fact that 
only the Reversing Direction cluster includes scenarios in 
which an object moves in more than one direction dur- 
ing a single described motion. Moreover, the Reversing 
Direction scenarios do not provide information as to how 
the speed of the object changes throughout its motion. 

Table |V] shows the responses that corresond with each 
of the models described above as well as the most com- 
mon student responses. The most common student re- 
sponses correspond directly with the responses indicat- 
ing the use of one of our described models. We note 
that Thornton only provided answers that indicated the 
direction of the force, not its magnitude. [T3] As such, 
there is no way to tell from his data the likelihood that 



a student used the F oc v model. Also, Thornton's work 
only looked at the questions pertaining to the force on 
the object. [13] His results, however, were replicated by 
one author (T.I.S.) for questions 27-29 asking about the 
object's acceleration. [28j 



2. False positives in vertical toss situations 



presentation. Students are provided with a description of 
the motion of a toy car and asked to select a graph that 
depicts the force exerted on the car. All of the correct 
responses indicate that the applied force is either zero or 



nonzero and constant. Table VI shows how responses to 
the questions in the Force Graphs cluster correspond with 
the various mental models as well as the most common 
student responses. 



We return to the point of requiring that students an- 
swer all three questions correctly (responses a-a-a within 
each question triplet). Consider the pattern of "a-d-a" 
responses on a given question triplet. pS] This student 
might believe that a constant downward force is exerted 
on the object while it is moving both upward and down- 
ward, but that no force is exerted while the object is 
"stopped" at the apex of its motion. This line of reason- 
ing may come from difficulties distiguishing between in- 
stantaneous velocity and change in velocity (as it relates 
to acceleration) . ^5] The student may use the reasoning 
that since the ball has zero velocity, it is not moving; 
therefore, the acceleration is zero and the force exerted on 
the object must also be zero by Newton's second law. For 
all of these reasons it is widely accepted that responses 
to the questions in the Reversing Direction cluster must 
be examined in conjunction with one another rather than 
individually, otherwise a student with serious problems 
understanding direction reversal will get 2/3 correct on 
this question triplet. 

Furthermore, consider two students who give very simi- 
lar incorrect responses: Student 1 answers "g-d-b" (con- 
sistent with F (X v) while Student 2 answers "g-d-a." 
Student 2's "a" response to the third question indicates 
a constant downward force or acceleration.^ The more 
general direction-of-motion model accounts for both sets 
of responses, though. Again, it would be inappropriate 
to give Student 2 a 1/3 correct score, even though answer 
"a" is correct. The correct response also distinguishes the 
F (X V model from the dircction-of-motion model. We do 
not believe, though, that the direction-of-motion model 
is 1/3 more correct than the F oc v model! For this rea- 
son, we agree with Thornton and SokolofF that a student 
should not be considered correct any part of a sub-cluster 
unless that student answers correctly on all three ques- 
tions. We thereby avoid measuring false positives in the 
Reversing Directions cluster. 



C. Force Graphs Cluster 

The Force Graphs cluster (see figure [2]) asks questions 
about motions sometimes identical in physics content to 
those found in the Force Sled cluster, but differing in 



'' The F Qc V model would require an increasing downward force 
for each of these questions. 



As with the Force Sled cluster, the most common stu- 
dent responses for the Force Graphs cluster correspond 
almost exactly with the responses indicating a student's 
use of the F oc v model. We separate the clusters to 
observe if students master the content of one cluster be- 
fore the other. Research suggests P [TOl [TT] that students 
do not display as much knowledge when working with 
graphs as when using descriptive language, and data from 
the FMCE support the separation of questions into two 
clusters. [Ilj The answers to the physics depend on the 
context and format of the question. Philosophically, this 
supports the use of a resources framework, which can 
account for differences in reasoning based on contextual 
and representational differences in resource activation. 

Note that in table |VI| we designate multiple responses 
for a single model on question 21. Students are asked 
about the force on a car once it has been released (after 
being pushed). On one hand, response "a" seems to fit 
perfectly with the F (x v model (see figure [2]) : the car 
moves at a constant velocity so a constant force must be 
applied. On the other hand, what if the students don't 
ignore friction (though they are explicitly told to do) or 
use an "impetus/force dies away" model? In each of these 
cases, the car would slow down at a (perhaps) steady 
rate, indicating a positive yet decreasing force (response 
"h" ) . Both of these responses can be considered a, F oc v 
model in the sense of the need for a "maintaining agency," 
with response "h" including the use of the "dying away" 
resource. 



Also consider question 17, where research by one au- 
thor (T.I.S.) has shown that some students who primarily 
use the F oc v model will choose response "a" instead of 
"b" (the F oc V response). Response "a" is not entirely 
different from "b" as it is congruent with the F oc v 
model in magnitude but not direction. This may corre- 
spond to a confusion between left and right as negative 
and positive, indicating a difficulty with coordinate sys- 
tems rather than with forces. As such we have decided 
to categorize response "a" to question 17 as indicative 
of the F oc V model if the student displays use of that 
model in other responses to this cluster. Strong empiri- 
cal evidence and the fact that question 17 is one of only 
two questions in the Force Graphs cluster to describe a 
motion with constant velocity heavily influenced our de- 
cision to consider response "a" as corresponding to the 
F oc V model. 



TABLE V: The "Reversing Direction" cluster on the FMCE. 



Question Constant Downward 
Number Force or Acceleration 



Force or Acceleration in 
the Direction of Motion 



F,a (X V 



Most Common Student 
Response [T3] 



8-9-10 


a-a-a 


(e, f, or g)-d-(a, b, or c) 


g-d-b 


(e, f, or g)-d-(a, b, or c 


11-12-13 


a-a-a 


(e, f, or g)-d-(a, b, or c) 


g-d-b 


(e, f, or g)-d-(a, b, or c 


27-28-29 


a-a-a 


(e, f, or g)-d-(a, b, or c) 


g-d-b 


g-d-b" 



"The most common responses for questions 27—29 can be found 
inRef [28]. 



TABLE VL The "Force Graphs" cluster on the FMCE. 



Question 
Number 


F 


"^ At 


F (X V 


Most Common 
Student Response fT31 


14 




e 


a 


a 


16 




a 


c 


c 


17 




e 


a, b 


b 


18 




b 


h 


h 


19 




b 


d 


d 


20 




R 


f 


f 


21 




e 


a, h 


h, f, a 



D. Acceleration Graphs Cluster 

The Acceleration Graphs cluster is similar to the Force 
Graphs cluster. Students are asked about the accelera- 
tion of a toy car undergoing various types of motion. 
Again, students must choose the graph they believe best 
represents the acceleration of the car for each scenario. 
It should be noted that the parenthetical reminders of 
"(constant acceleration)" that are found in the questions 
of the Force Graphs and Force Sled clusters are omit- 
ted from these questions. We examine the Acceleration 
Graphs cluster from the perspective of students' difficul- 
ties distinguishing between the concepts of acceleration 
and velocity reported by Trowbridge and McDermott[2S] 
to form a type of acceleration-proportional-to-velocity 
(a ex v) model. The most common student responses 
shown in table |VII| correspond closely with the a ex w 
model. 



TABLE VII: The "Acceleration Graphs" cluster on the 
FMCE. 



Question au 

Number ^* 



Most Common 
Student Response [13] 



22 


a 


e 


e 


23 


b 


g 


f 


24 


c 


b 


b 


25 


b 


f 


f 


26 


c 


a 


a 



question asks students to choose the appropriate graph 
of acceleration vs. time for a car that "moves toward 
the right (positive direction), slowing down at a steady 
rate."^ Figure [s] shows responses "f and "g" that cor- 
respond to the most common student response and the 
a ex w response, respectively. Visually, responses "f 
and "g" are incredibly similar, with identical magnitude 
slopes. They are also presented above one another (see 
figure pi) . Even though response "f ' would only accu- 
rately fit the a (X V model for a car moving to the left 
and speeding up (as in question 25), it is not surprising 
that students would choose "f ' for question 23. Again, as 
with question 17, the problem may indicate issues with 
coordinate systems more than the relationship between 
acceleration and velocity. 



® 



& 




FIG. 5: Responses "f and "g" for the Acceleration Graphs 
cluster. 



E. Newton III Cluster 

The Newton's third law cluster is the only cluster that 
commonly elicits two different incorrect student models: 
the mass dependence model and the action dependence 
model described above. Table IVIIII shows how the re- 
sponses to the questions in the Newton III cluster sepa- 
rate into these models. 

The most common student responses shown in table 



VIII incorporate aspects of both the mass dependence 
and the action dependence models.^ We see that the 



We note a discrepancy between the a oc w model 
and the most common response for question 23. This 



* It should be noted that Thornton's study (Rel. I13p did not in- 
clude the questions from the Newton III cluster. The most com- 
mon student responses are those reported by one author (T.I.S.) 



TABLE VIII: The "Newton III" cluster on the FMCE. *- 
Categorization for this response depends on the student's 
choice for question 36. 



Question 


Forces 


Mass 


Action 


Most Common 

Student 
Response |28| 


Number 


Equal Dependence 


Dependence 


30 


e 


a 


XX 


a 


31 


e 


a 


b 


e, f 


32 


e 


a 


b 


b 


34 


e 


XX 


b 


b 


36 


a 


b 


c 


c 


38 


a 


b* 


b*, c 


b 



most common set of responses shows more agreement 
with the action dependence model (questions 32, 34, 36, 
and 38) than the mass dependence model (question 30). 
Response "b" as the most common response for question 
38 might seem a bit ambiguous (as it can be classified as 
either mass or action dependence), but one can use re- 
sponse "c" for question 36 to then categorize both as uses 
of the action dependence model. As with much of our 
analysis, this requires the assumption that students are 
reasoning relatively consistently from question to ques- 
tion. 



Questions 30-34 refer to collisions between a cai' and tnjclc For each 
description of acollisian (30-34-) below, clioose tlie one answer from 
the possibilities A tl:iiDugh J tliat best describes tlie fbrees bet'ifeen tlie 
cai" Euid tlie t"uck. 

A. Tlie tinck exeits a greater aniouiit of foice on tlie cai' tlian tlie cai" 
exeits on tlie tniok. 

B. Tlie car exeits a greater aniomit of foice on tlie tmck tliaii tlie tnick 
exeits on tlie cai'. 

C. Neitlier exeits afbree on tlie otlier, tlie cai" gets siiiaslied simply 
because it's in tlie way of the tnick. 

D. Tlie tiiick exeits a foice an tlie cai'. but tlie cai' ctoesn't exeit a foice 
on tlie t'uck. 

E. Tlie tuck exeits tlie same anioiait of foice on tlie cai' as Uie cai" 
exeits on tlie tnick. 

F. Not enough iiifomiation is given to pick one of tlie aiisweis abo're. 
J. None of tlie aiisweis above describes tlie situation coiTectly. 



Inqiiestistii SOihrongh 32 
the truck is much hemier 
than the car. 



_30. Tiey ai'e botli moving at tlie same speed wlien tliey collide. 

Wliich clioice describes tlie foices? 
_31. Tie cai' is moving much faster tliaii tlie lieavier tiick wlien 

tliey collide . Wliich clioice describes tlie foices? 
_32. Tie lieavier t"uck is staixliiig still wlien Uie cai' liits it. 

Wliich elioiee describes tlie foices? 




In qiiestiom 33 and 34 the 
tnick is a small pickup and 
is the same weight as the 
car. 

33. Botli tlie tiTick and the cai' ai'e nuving at the same speed 

wlifin tliey collide. Wliich clioice describes tliefbi'ces? 

34. Tie ti'uck is standing still wlien tlie cai' liits it. Wliich 

clioice describes tlie fbices? 



1. False positives in collision situations 

The assumption of consistent reasoning has serious 
consequences when one considers question 31. Many stu- 
dents who answer "e" on question 31 (the correct answer) 
answer incorrectly on questions 30, 32, and 34. ^ (see 
figure [6| . 

We can infer with a fair degree of certainty why most 
students respond the way they do to questions 30 and 
32. In question 30, both vehicles are moving at the same 
speed before the collision (making action dependence a 
moot point), but the truck is much heavier than the car 
causing students to lean heavily toward mass dependence 
reasoning. In question 32, the truck is still much heav- 
ier than the car, but it isn't initially moving. As such, 
the greater "activeness" of the car wins out and students 
use action dependence. But what happens between these 
situations? If the same two objects can interact in two 
different ways to get opposite results, there must be a sit- 
uation in which the effects of mass dependence and action 
dependence will compromise or cancel out. In question 
31, the smaller, lighter car is initially moving much faster 
than the bigger, heavier truck, but the truck is moving. 
In this case our "most common student" must decide 



FIG. 6; Questions involving collisions -within the Newton III 
cluster of the FMCE. Please note that question 33 is not in- 
cluded within analysis of the FMCE. [Til 



how to deal with mass dependence ideas from question 30 
and action dependence ideas from question 32. Response 
"e" is one logical conclusion. The two effects cancel each 
other out to result in the car and the truck exerting forces 
on each other that are equal in magnitude but opposite 
in direction. A more discerning student, however, may 
feel that the effects will cancel each other to some degree 
but not necessarily completely, leading to response "f," 
that more information is needed. Figure [7] shows how the 
mass dependence and action dependence resources may 
"balance" to produce the correct conclusion. 

To avoid the measurement of false positives, we suggest 
clustering responses 30-32 into a "triplet" sub-cluster as 
done on the question triplet sub-clusters in the Reversing 
Directions cluster. Otherwise, one incorrectly rewards 
students for a situation where two different wrongs do, 
in fact, make a right. 



2. False positives in pushing situations 



in Ref. 1281 . 
® question 33 is not included in analysis of the FMCE.|14| 



A situation exists where two identical wrongs make a 
right, as well. As shown in table |VIII| the most com- 
mon responses for question 36 and 38 are "c" and "b," 
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FIG. 7: The mass dependence and action dependence re- 
sources may be used together to cancel out some of their 
effects based on the situation (as in question 31). 



respectively (the questions are given in figure Isl) . Many 
students, however, choose responses "c" and "a" for these 
two questions. ^° Response "a" for question 38 indicates 
a correct answer of equal and opposite forces exerted by 
the two vehicles on each other. Response "c" for question 
36, on the other hand, indicates the student's use of the 
action dependence line of reasoning. 

We again assume some consistency of student rea- 
soning within a cluster of questions (that are contextu- 
ally and representationally similar). In question 36 the 
smaller car is pushing the heavier truck, and the two 
are speeding up. Use of the action dependence resource 
suggests that the car is exerting a greater force than 
the truck (response "c"). This result agrees with the 
pushing contextual feature reported by Bao, Hogg, and 
ZoUman.pi] In question 38, however, the two vehicles 
are at a constant cruising speed, and the truck begins to 
apply its brakes, causing both vehicles to slow down. Re- 
sponse "b" for question 38 (the truck exerts more force) 
might be indicative of action dependence reasoning. 

When the truck begins applying its brakes, it may 
become the more active object in the student's mind, 
causing the vehicles to slow down. Once again, we have 
the possibility of two effects of incorrect resoning act- 
ing against one another. The car is the active agent, 
pushing the truck forward. The truck is a second active 
agent, pushing back against the car. A student might 
believe that the two effects will perfectly balance each 
other and might arrive at the correct response ("a") in 
which the two vehicles exert equal amounts of force on 
one another. This result is quite similar to that found for 
response "e" on question 31 with the exception that ques- 
tion 38 presents the opportunity for students to use two 
conflicting versions of action dependence and eliminates 
the need for mass dependence. 



Questions 35-3S iiefer to a laige 
tixick wliich biiealffi ctaTHii on tlie 
iioad aiicl lEceivES a push back 
to town by a small compact cai'. 

Pick one of tlie clioices A tliiDugh J below wliich coiTcctly clesciibes 
the fbrces between tlie cai' aixl tlie ti"uck for each of tlie clesciiptioiis 
(33-3S). 

A. Tlie fome of tlie cai' pusliiiig against tlie tmck is equal to tliat of Uie 
tiTick pusliing back against tlie cai". 

B. Tlie fome of tlie cai" pusliing against tlie ti"uck is less tlian tliat of 
tlie tiick ptisliiiig back against Uie cat". 

C. Tlie force of tlie cai" pusliing against tlie tmck is greater tlian tliat of 
tlie tiTick pusliing back against flie cai". 

D. Tliecai"'s engine is umiiing so it applies a force as itpuslies against 
the ti"uck, but tlie ti"uck's engine isn't i"miiiing so it can't push back 
wiUi a force against Uie cai". 

E. Neitliei" tlie cai" iioi" Uie ti"uck exeils any foice on each otliei". Tie 
tiTick is puslied foi"waid simply because it is in Uie way of tlie cai". 

J. None of tliese descriptions is conect. 



_35. Tlie cai" is ptisliiiig on tlie tuck but not liaid enough to 

iiialtE it move. 
_3fi. TliE cai". still pusliing on tlie ti"UEk. is qwecliiig up to get to 

ci"uisiiig speed. 
_37. Tlie cai". still pusMiig tlie ti"uck, is at ciuising speed and 

continues to ti^avEl at tlie same speed 
_3S. Tlie cai". still pusMiig tlie ti"uck. is at ciuising speed wlieii 

Uie ti"uck puts on its bicdtes anil causes Uie cai" to slow dowu. 



^^ These respon ses oft en occur with the most common responses 
listed in table |"VIII| for questions 30-34. [28] 



FIG. 8: Questions involving one vehicle pushing another 
■within the Newton III cluster of the FMCE. Please note that 
questions 35 and 37 are not included within analysis of the 
FMCE. 14 



F. Velocity Graphs Cluster 

The Velocity Graphs cluster is very similar to the pre- 
viously described "graphing" clusters. Students are pre- 
sented with various descriptions of a car's motion, and 
they must choose the correct velocity vs. time graphi- 
cal representation of the motion. As with the Acceler- 
ation Graphs questions, the incorrect model we exam- 
ine is derived from Trowbridge and McDermott's studies 
of students' understanding of kinematics and their diffi- 
culty distinguishing position from velocity. [30] This ve- 
locity/position confusion model is also closely related to 
Beichner's proposition that students view graphs as a pic- 
ture of the situation no matter what the axes indicate. [S] 
Table IX shows how the responses in this cluster corre- 
spond with the various student models. 

Once again, more than one response to a single ques- 
tion may indicate the use of our incorrect model. On 
question 42, the toy car is said to be "moving toward the 
left (toward the origin) at a steady (constant) velocity." 
Responses "c" and "h" (shown in figure l9| both indicate 
a graph that gets steadily closer to the horizontal axis 
as time progresses. For response "c" a student could be 
picturing the car starting at the right and moving toward 
"0," and students choosing "h" could be triggered by the 
word "left" to choose a graph that depicts negative ve- 
locity. 

As an aside, we note that questions 17, 23, and 42 
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TABLE IX: The "Velocity Graphs" cluster on the FMCE. 



^ ,. Correct Velocity/ 
Question ^^ , , _ ^ .^. •" 
»T , Model tor Position 

Velocity Confusion 


Most Common 

Student 
Response [T5] 


40 a d 

41 f g 

42 b c, h 

43 d XX 


d 

g 
c 

XX" 



"Thornton reports the most common student response for ques- 
tion 43 as "not signifieant." 13 



© 
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TimE 



FIG. 9: Responses 
ter. 



and "h" for the Velocity Graphs clus- 



form a cluster which lets one see if students have prob- 
lems understanding coordinate systems, allowing for a 
finer grained analysis of students' understanding of force 
and motion. The FMCE only measures this topic implic- 
itly, though, and the cluster is therefore relatively badly 
defined. 



G. Energy Cluster 

The Energy cluster on the FMCE contains questions 
that ask students to reason about the speed and kinetic 
energy of a sled after sliding down a hill. The incor- 
rect model for the questions in the Energy cluster, as 
described in section |III[ corresponds with the idea that 
steeper hills will cause a greater change in speed and ki- 
netic energy as the sled slides down. Table pC| shows how 
the possible responses to questions in this cluster are di- 
vided among the correct and this incorrect model. The 
most commonly given incorrect answers correlate with 
the responses indicating a student's use of the slope de- 
pendent model. 



TABLE X: The "Energy" cluster on the FMCE. 

Energy/ Energy/ Most 

Question Speed Speed Common 

Number Depends on Depends on Student 
Height Slope Response" 



44 


b 


a 


a 


45 


b 


a 


a 


46 


a 


c 


c 


47 


a 


c 


c 



"Most common student responses for the energy cluster discovered 
by research reported in Ref. I28| . 



rect and incorrect responses using a single language of 
resource activation. 

Our clusters (Force Sled, Reversing Direction, Force 
Graphs, Acceleration Graphs, Newton III, Velocity 
Graphs, and Energy) take into account the physics con- 
tent, the contextual aspects, and the representations used 
to ask the questions. We show that students' incorrect 
responses to questions on the FMCE may be indicative 
of a variety of mental models that correspond with well 
documented research results. Using the resources frame- 
work, we can analyze sets of questions within some clus- 
ters (Reversing Direction and Newton III) to describe 
some correct student responses as false positives. 

We have presented interpretations for the most com- 
mon incorrect responses for each questions, but this is in 
no way an exhaustive list of the possible mental models 
that may be used by students while answering questions 
on the FMCE. Additional patterns of responses should 
be examined for prevalence among student responses and 
analyzed in terms of mental models that may be indi- 
cated by each. For example, questions 17, 23, and 42 are 
a "coordinate systems" cluster that has not yet been eval- 
uated but may affect student responses on other clusters. 
Also, a second tier of mixed-context clusters of questions 
(such as Bao's[Tn]) could be created that "slice" data in 
different ways. 

Research tools such as the FMCE are most effective 
to educators and researchers only when responses are ex- 
amined to determine not only whether or not students 
have the correct ideas, but also what ideas they do have 
(correct or otherwise) and how consistently they use these 
ideas across similar questions. Our clustering allows such 
an analysis, giving insight into both how we model stu- 
dent thinking and how we could better address student 
needs in the classroom. 



V. SUMMARY 

We have described a method for clustering questions 
on the FMCE that lets us use a resources framework 
to account for the most common student responses as 
reported by either Thornton |1 3 j or in the work of one 
author |5^. Our clustering allows us to categorize cor- 



Acknowledgments 

We thank three reviewers for their valuable comments 
and insights on an earlier version of this paper. Sup- 
ported in part by NSF grants DUE-0510614 and REC- 
0633951. Portions of this manuscript originally published 



in Ref. 



12 



[1] D. Hestenes, M. Wells, and G. Swackhamer, Force Con- 
cept Inventory, The Physics Teacher 30, 141 (1992). 

[2] R. R. Hake, Interactive-engagement versus traditional 
methods: A six-thousand-student survey of mechanics 
test data for introductory physics courses, American 
Journal of Physics 66, 64 (1998). 

[3] R. K. Thornton and D. R. Sokoloff, Assessing student 
learning of Newton's laws: The Force and Motion Con- 
ceptual Evaluation and the Evaluation of Active Learning 
Laboratory and Lecture Curricula, American Journal of 
Physics 66, 338 (1998). 

[4] M. C. Wittmann, On the dissemination of a 
proven curriculum: RealTime Physics and In- 
teractive Lecture Demonstrations, available at 
http : //perlnet . umephy . maine . edu/research/ 
Wittmann2002RTPpaper .pdf . 

[5] E. F. Redish, J. M. Saul, and R. N. Steinberg, On the 
effectiveness of active-engagement microcomputer-based 
laboratories, American Journal of Physics 65, 45 (1997). 

[6] D. Hammer, Student resources for learning introductory 
physics, American Journal of Physics 67 (Physics Ed- 
ucation Research Supplement), S45 (2000). 

[7] J. Minstrell, Facets of students' knowledge and relevant 
instruction, in Research in Physics Learning: Theoreti- 
cal Issues and Empirical Studies, Proceedings of an In- 
ternational Workshop, Bremen, Cermany 1991, edited 
by R. Duit, F. Goldberg, and H. Niedderer (IPN, Kiel, 
1992), pp. 110-128. 

[8] M. C. Wittmann, Using resource graphs to represent 
conceptual change, Phys. Rev. ST Phys. Educ. Res. 2, 
020105 (2006). 

[9] R. J. Beichner, Testing student interpretation of kinemat- 
ics graphs, American Journal of Physics 62, 750 (1994). 
[10] P. B. Kohl and N. D. Finkelstein, Effects of representa- 
tion on students solving physics problems: A fine-grained 
characterization, Phys. Rev. ST Phys. Educ. Res. 2, 
010106 (2006). 
[11] P. B. Kohl and N. D. Finkelstein, Student represen- 
tational competence and self-assessment when solving 
physics problems, Phys. Rev. ST Phys. Educ. Res. 1, 
010104 (2005). 
[12] D. J. Dykstra, Why teach kinematics? An examination of 
the teaching of kinematics and force-I (2002), available 
at http: //www.boisestate . edu/physics/dykstra/ 
WTKl.pdf. 
[13] R. K. Thornton, Using large-scale classroom research to 
study student conceptual learning in mechanics and to 
develop new approaches to learning, in NATO ASI Series 
(Springer Verlag, 1993). 
[14] R. K. Thornton, Conceptual dynamics: Changing student 
views of force and motion, in Thinking Physics for Teach- 
ing, edited by C. Tarsitani, C. Bernardini, and M. Vin- 
centini (Plenum Publishing, 1995). 
[15] R. K. Thornton and D. R. Sokoloff, Learning motion 
concepts using real-time microcomputer-based laboratory 
tools, American Journal of Physics 58, 858 (1990). 
[16] L. Bao, unpublished Ph.D. dissertation, available at 
http: //physics .umd. edu/perg/dissertations/. Uni- 



versity of Maryland (1999). 

[17] J. H. Wandersee, J. J. Mintzes, and J. D. Novak, Re- 
search on alternative conceptions in science, in Handbook 
of Research of Science Teaching and Learning (Macmil- 
lan Publishing, New York, 1994), pp. 177-210. 

[18] S. Vosniadou and W. F. Brewer, Mental Models of the 
Earth: A Study of Conceptual Change in Childhood, Cog- 
nitive Psychology 24, 535 (1992). 

[19] A. diSessa, Towards an epistemology of physics, in Cog- 
nition and Instruction (Lawrence Erlbaum Associates, 
Inc., 1993), vol. 10, pp. 105-225. 

[20] D. Hammer, A. Elby, R. E. Scherr, and F. Redish, Ed- 
ward, Resources, framing, and transfer, in Transfer of 
Learning: Research and Perspectives (Information Age 
Publishing, Greenwich, CT, 2005). 

[21] R. E. Scherr, Modeling student thinking: An example 
from special relativity, American Journal of Physics 75, 
272 (2007). 

[22] D. E. Brown and J. Clement, Overcoming misconcep- 
tions via analogical reasoning: Abstract transfer versus 
explanatory model construction, in Instructional Science 
(Kluwer Academic Publishers, Dordrecht, Netherlands, 
1989), vol. 18, pp. 237-261. 

[23] I. A. Halloun and D. Hestenes, Common sense concepts 
about motion, American Journal of Physics 53, 1056 
(1985). 

[24] L. Bao, K. Hogg, and D. Zollman, Model analysis of fine 
structures of student models: An example with Newton's 
third law, American Journal of Physics 70, 766 (2002). 

[25] T. I. Smith and M. C. Wittmann, Comparing three meth- 
ods for teaching Newton's third law, Phys. Rev. ST Phys. 
Educ. Res. 3, 020105 (2007). 

[26] D. P. Maloney, Rule-governed approaches to physics: 
Newton's Third Law, Physics Education 19, 37 (1984). 

[27] D. Hammer and A. Elby, Tapping epistemological re- 
sources for learning physics. Journal of the Learning Sci- 
ences 12, 53 (2003). 

[28] T. I. Smith, Comparing the Effectiveness of Research- 
based Curricula for Teaching Introductory Mechan- 
ics (2007), unpublished Masters thesis, available at: 
http: //www . umaine .edu/center/MST/SmithThesis .pdf. 

[29] D. E. Trowbridge and L. C. McDermott, Investigation 
of student understanding of the concept of acceleration 
in one dimension, American Journal of Physics 49, 242 
(1981). 

[30] D. E. Trowbridge and L. C. McDermott, Investigation 
of student understanding of the concept of velocity in one 
dimension, American Journal of Physics 48, 1020 (1980). 



